CAMERA CONTROL IN A PROCESS CONTROL SYSTEM 

[01] This application is a continuing application of PCT patent application 
PCT/F 1 00/00692, filed August 5, 2000, and claiming priority from Finnish pat- 
ent application FI19991890 filed September 3 1999. 

FIELD OF THE INVENTION 
[02] The present invention relates to a process control system and a camera 
monitoring a process. 

BACKGROUND OF THE INVENTION 

[03] Programmable logic controllers (PLC) have developed from simple de- 
vices in the early 1970's that used integrated circuit technology and were able 
to carry out simple repeating control tasks, to small and complex systems able 
to perform nearly all kinds of control applications requiring ability to data proc- 
essing and advanced computations. PLC's can be integrated to large systems 
in which various logic units communicate with each other as well as with com- 
puters controlling operation of a factory. Industrial applications for PLCs can be 
found especially in production, petrochemistry, construction industry, and food 
and beverage industries, where they control temperatures and electro- 
mechanical devices, such as valves, conveyors etc. 

[04] A programmable logic used as a control unit may include dozens or hun- 
dreds of I/O ports. Typical devices connected to input ports are pushbuttons, 
limit switches, proximity switches, and temperature sensors. Solenoids, mo- 
tors, contactors etc. can be connected to output ports. In brief, the Program- 
mable Control Logic (PCL) operates by scanning its inputs and registering their 
states. The PLC then modifies the states of the outputs to ON or OFF state, in 
accordance with the control program. This scanning and response process is 
repeatedly preformed. The entire scanning cycle takes usually 1 to 40 ms, but 



depends naturally on the length of the program and on how long time it takes 
to carry out the commands. Once the program has been written, it is easy to 
utilise: the needed devices are connected to the input and output ports, 
whereupon a complete process control system has been created. 

[05] In many applications, especially in those monitoring the shape, dimen- 
sions and location of a product, machine vision is of great advantage. A CCD 
camera (Charge Coupled Device) is mainly used, on the sensors of which a 
picture of the target is formed. The analog signal is converted into a digital one 
and transmitted to an image-processing card where different image-processing 
operations take place. 

[06] When a camera picture is connected to the input of a programmable 
logic controller, the process control system illustrated in FIG. 1 is obtained. The 
processes to be controlled consist of various functions that need to be con- 
trolled and adjusted. One of these functions has been marked with dashed line 
14 in FIG. 1. Actuator 15, e.g. a burner of an oven, energizes the process. A 
sensor measures a value for the regulating unit, in this case the temperature of 
the oven. The signal of the sensor is fed to programmable logic 11. After the 
scanning period the logic controls to actuator 15 in accordance with the control 
program. 

[07] CCD camera 13 is used as a sensor and it has been connected to com- 
puter 16 via a video bus. The computer contains an image-processing card 
and it may be a common multipurpose PC. The computer processes the image 
according to an image processing program and gives the results to program- 
mable logic 11 via a connection bus. In this example, the CCD camera would 
monitor the shape and color of the products coming out of the oven. 

[08] A system similar to FIG. 1 has been presented in the patent application 
DE-4325325. There the logic is programmed with a programming device con- 



sisting of a keyboard, a monitor and a CPU. The video input of the program- 
ming device is cabled to the video output of a remote process control camera. 
The video picture from the camera can be seen on the display and the logic 
can then be programmed as desired. In this case the video camera serves only 
as the user's visual aid. 

[09] A so-called smart camera can be used as well. It contains circuits and 
software needed for image-processing. An image can then be processed in the 
camera itself, and no computer is needed. Programming of a smart camera 
depends on the manufacturer, which means that a programmer specialized in 
each type of camera is needed. In many cases the camera is supplied to the 
user custom programmed according to user specifications. 

[10] Programmable logic devices are able to intercommunicate and exchange 
messages via a field bus. The most common field bus protocols are Modbus 
and Profibus, the latter having been specified in European Committee for Elec- 
trotechnical Standardization (SENELEC) standard EN 50170. The protocols 
define the message structure very precisely, and the devices are classified to 
master and slave devices. Modbus uses RS 232C and Profibus uses mainly 
RS 485 transfer technology. 

[11] In order to give a clarifying example the Modbus protocol will be ex- 
plained here more in detail. The protocol defines how a device knows its own 
device address, recognizes a message addressed to it, knows what functions it 
has to do and is able to distinguish data from a message. If the data transfer 
system is other than the Modbus, e.g. the Ethernet or the TCP/IP network, the 
messages are embedded into the frames or packets of the network in ques- 
tion. Communication always takes place using the master-slave principle, i.e. 
only the master device is able to start the transactions whereas the slave de- 
vice responds by sending the requested data or by performing the functions 
asked by the master. Usually the master is a programmable logic and the slave 



device a peripheral, such as an I/O device, a valve, a driver or a measuring 
apparatus. 

[12] In FIG. 2 a message structure in accordance with the Modbus protocol is 
presented. The message starts with a "Start" sign, i.e. a semicolon, and ends 
to an "End" sign, which is a CRLF (Carriage Return-Line) sign. After the start 
sign there is the individual address of the target device. When replying to the 
message the target device relocates its own address in this field, on the basis 
of which the master device knows where the reply had come from. 

[13] The code to be given in the "function" field, which comes next, may have 
values from 1 to 255 (given in decimal numbers). It tells what kind of a function 
the slave device has to perform. When giving an answer the target device uses 
this field in order to indicate either that the answer was correct or that an error 
had occurred during the performance of the task. 

[14] In the next field, the "data" field, the master device gives information 
needed by the slave device for performing the given task. When replying the 
slave device relocates the data resulted from the performed task in this field. 

[15] The error checking field contains the error checking of the message con- 
tents, either a LRC or a CRC error check sum. 

[16] FIG. 3 presents a case where a camera as a peripheral is connected to 
the programmable logic using a known field bus. The logic in programmable 
logic controller 11 and computer 16 have RS 232 connections. Unlike in FIG. 1 
there is a bi-directional connection between the computer and the programma- 
ble logic, in this case the Modbus. This means that the logic can ask the com- 
puter when it has finished its computations. The computer 16 carries out in ad- 
vance the image-processing programmed into it, and the logic cannot interfere 
in any way. It only receives the results. 



[17] A system like this is presented in the patent US-5882402. The process 
consists of drawing optical fiber out of a molten crystal. The image-processing 
unit has an image processor and it is attached to a camera that monitors the 
fiber. The image processing unit is further connected to the programmable 
logic by means of a duplex data transfer channel. The logic is programmed via 
the operator's computer. The image-processing, i.e. the camera, is pro- 
grammed via a computer connected to the image-processing unit. One possi- 
ble procedure is to combine the computer connected to the image-processing 
unit with the operator computer. According to the specification the merged 
computer acts as a user interface in order to program the programmable logic. 
Here we can, at least in theory, program both the logic and the image- 
processing of the camera using the same user interface. However, the pro- 
grams of each device are different to the extent that the process operator must 
have a deep knowledge of the camera software. 

[18] FIG 4 presents a case in which the camera and the computer have been 
replaced with so-called smart camera 41. The field bus is directly connected to 
the interface of the camera. In this case, too, the camera program processes 
the image in advance according to the program and the logic cannot interfere 
in any way. It only receives the results. 

[19] The problem with these two cases, where the camera is connected to the 
programmable logic via a field bus, is that the smart camera or the computer 
must be made able to perform the tasks the logic asks for and provide the task 
results back to the logic. The camera is programmed to give only the re- 
quested results, and if any other information is required, the camera has to be 
reprogrammed. The programs for the computer and the smart camera differ 
from one software vendor to another, which means that they require special 
know-how. The manufacturer very often programs the device according to the 
customer's instructions prior to delivery. If the customer wishes to have any 



modifications in the controlled process, or if he wishes that the camera gives 
other values than before, changes in the camera software must be made. 
Then the supplier is requested to send a specialist programmer to do the modi- 
fications. On the other hand, the programming of a PLC requires expertise and 
know-how that the process supervisor must naturally have. When the process 
supervisor wants the camera to provide new information as a response to a 
new command, prolonged cooperation is often needed between the process 
supervisor, who knows to PCL program, and the programmer specialized in 
programming cameras. This is both expensive and time-consuming, as the re- 
programming costs are high and two persons are needed to do the work: one 
takes care of the camera, the other of the programmable logic. 

[20] There is an attempt to overcome this problem by making it easier to 
(re)program a smart camera, namely by using different types of graphical inter- 
faces. There are programs of Windows® type suitable for various machine vi- 
sion applications. These programs, e.g. AEInspect and FlexAuto for Windows, 
made by Automation Engineering Inc. USA, work in common multipurpose 
PCs. Despite these programs alleged ease off use, they require a high level of 
expertise that a process supervisor seldom has. Additionally, changing the 
camera programming requires physically accessing the cameral, sometime an 
inconvenient or dangerous undertaking. 

SUMMARY OF THE INVENTION 
[21] An objective of the present invention is to devise a camera control con- 
nected to a process control unit, especially to the programmable logic control- 
ler, so that the control does not have the drawbacks of the prior art systems. 
The objective is a system in which the operator of the control unit can easily 
program the computer connected to the camera or the smart camera so that 



the computer of the camera can perform tasks defined in a query message 
sent via a data transfer channel as well as relocate the task results in the reply 
message. 

[22] The invention is based on the insight that the computer linked with a 
smart camera or an ordinary camera can be provided with an adaptation pro- 
gram. This program is able to compile the tasks given by the process control 
unit to a language understood by the camera software. Correspondingly, it can 
send the task results to the control unit. The amount of parameters needed for 
the tasks and their performance is only limited by the ability of the camera 
software to carry out the tasks. 

[23] Another insight is to transmit the command tasks from the process con- 
trol unit to the smart camera or the computer, and, correspondingly, the task 
results to the process control unit in accordance wit a known transmission pro- 
tocol. Hence, the adaptation program acts as a compiler between the protocol 
used and the specific software of the camera. As a data transfer link it is favor- 
able to choose a prior art field bus using the Modbus or the Profibus protocol. 

[24] Before the user of the programmable logic brings the system into use he 
makes a comprehensive list of all image-processing tasks he wants the cam- 
era software to perform. Each task gets a code, which is a number, for exam- 
ple. Additionally, each task is provided with an adequate number of parameters 
needed to perform the task. After that an adaptation program is created. The 
adaptation program is constructed to extract task codes and parameters from 
the messages transferred by data link using the selected protocol. The task 
codes and parameters are compiled into a set of tasks that the specific camera 
software is capable of performing. The adaptation program gives the task 
codes, optionally with its parameters, to the camera or image processing soft- 
ware. Then the software performs the task according to the task code and re- 
turns the task results to the adaptation program in a form that it is able to un- 



derstand. After this the adaptation program forms a reply message according 
to the used data transfer protocol, locates the results in the reply message and 
transmits the message via the transmission channel. All tasks provided by the 
adaptation program to the image-processing program are understood by the 
latter. 

[25] Besides the adaptation program another program is created in the proc- 
ess control unit, e.g. in the programmable logic. This program may include any 
task directed to the image processing/camera program, provided such tasks 
are understood by the adaptation program. The control unit program may 
now be modified whenever such modifications are needed, as long as such 
modifications include codes understood by the adaptation program. New tasks 
can be included in the control unit program or the parameters of existing tasks 
can be changed without any need to modify the camera software or the adap- 
tation program. 

[26] If desired, the image signal from the camera can be fed, using a separate 
connection, to a monitor in the process supervisor's facilities. Then the super- 
visor sees the picture of the target and is able to give various tasks to the 
camera in a very flexible manner. It is easiest to give the tasks via the same 
user interface with which the process control unit is normally programmed. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[27] The invention is described more in detail with reference to the accompa- 
nied schematic drawings in which 

[28] Fig. 1 shows a known process control system in which the camera is 
used as a sensor; 

[29] Fig. 2 shows message fields according to the Modbus protocol; 



[30] Fig. 3 shows a known system in which a camera linked to the computer is 
connected to a programmable logic via a field bus; 

[31] Fig. 4 shows a known system using a smart camera; 

[32] Fig. 5 illustrates in broad outline how a adaptation program is developed; 

[33] Fig. 6 shows schematically functions of a proceeding logic program; 

[34] Fig. 7 illustrates an embodiment of the system based on the invention; 

[35] Fig. 8 shows a picture to be examined; 

[36] Fig. 9 is a structure of the query message; 

[37] Fig. 10 is a structure of the reply message; 

[38] Fig. 1 1 shows another embodiment based on the invention, and 

[39] Fig. 12 is a partial enlargement of Fig. 1 1 

DETAILED DESCRIPTION OF THE INVENTION 
[40] Fig. 5 illustrates how a system based on the invention is brought into use. 
When a camera is connected to a programmable logic or a factory system one 
has to define what kind of information the image-processing software of the 
camera should produce, step 51. The desired information depends naturally on 
the target of the camera. If the target is for instance an object with an addi- 
tional part, that area of the picture is viewed where the additional part is sup- 
posed to be. In this area the image-processing program examines whether the 
part has been attached or if it is missing. Hence, the number and nature of the 
tasks to be performed depends on each project. 

[41] When the tasks have been determined, an individual code, a task num- 
ber and the needed parameters are attached to each task, step 52. For in- 
stance, task number 1 could signify that the average shade of gray of a picture 



should be calculated. The parameter associated with this task would give the 
pixel density used in calculation; the parameter value would e.g. mean that 
every fourth pixel ought to be counted. 

[42] When all the tasks have been determined, equipped with a code and pa- 
rameters, an adaptation program can be written. This program understands 
what the image-processing program has to do, step 53, on the basis of the fig- 
ures in the data field that have been sent in a message according to the bus 
protocol. The adaptation program must know how to compile the tasks defined 
above to a language understood by the camera software in such a manner that 
the software is able to carry out the tasks. The adaptation program also has to 
be able to receive the results from the camera program and to relocate them 
correctly in a reply message according to the data transfer protocol, as well as 
to pass the message to a data transfer channel. 

[43] When the adaptation program has been created it is installed in the cam- 
era, step 54. After the control program has been programmed in the process 
control unit that uses the above mentioned task codes and parameters in the 
messages that it sends to the camera, the system is ready for use. The proc- 
ess operator now easily determines what the camera software does by chang- 
ing the values of the parameters at any time. 

[44] Form here on, we shall use the Modbus protocol and data link to provide 
an example of the process control by programmable logic. 

[45] In Fig. 6 the function of the system is illustrated during the process. Let 
us suppose that the software of the logic has proceeded to a point where it 
needs information from the camera, step 61. Then the software makes a query 
message according to the bus protocol used, step 62. It puts in this message 
the task code and parameters, the realization of which provides the information 



needed by the logic program. When the query is ready, it is sent to the bus, 
step 63. 

[46] The adaptation program recognizes that the query is addressed to it from 
the device address, and opens it, step 64. The adaptation program under- 
stands from the task code of the message what the camera program has to do. 
The adaptation program then transfers the task and the related parameters to 
the camera program, step 65. The camera program carries out the given im- 
age-processing task, step 66, and returns the results to the adaptation pro- 
gram, step 67. The adaptation program then forms a reply according to the bus 
protocol and relocates the results from the camera program into it, step 68. 

[47] During the previous steps the logic program has regularly polled the de- 
vices connected to the bus. When the camera is polled, it sends a reply, step 
69. The logic receives the message from the bus and recognizes the task re- 
sults in the data part, step 610, and supplies this result to point 61 of the logic 
program that requested the information. 

[48] In the logic program there may be several points that need information 
about the picture taken by the camera. The logic program may also ask the 
camera program more precise questions on the basis of received information. 
The program in the logic control unit utilizes the reply from the camera unit in a 
manner required by the program. Depending on the application the program 
may ask the camera one or more additional questions before the process is in- 
fluenced or any decision made. A conveyor could serve as an example. It may 
transport objects of five different sizes. The system based of the invention 
should decide whether the each of the objects is acceptable or should be re- 
jected. When the camera has viewed the object and its picture has been 
transmitted to the image processing program, the logic sends, e.g. triggered by 
a photocell, the first query to the camera asking about the dimensions of the 
object. The camera program calculates the dimensions from the picture and 



the application program sends the information to the logic. On the basis of the 
information the logic program concludes which one of the five objects is con- 
cerned. After this the logic program branches out to the program branch con- 
cerning this very object and may ask the camera many additional questions. 
As a response to the queries the camera software calculates the required data 
from the saved picture and sends them as replies to the programmable logic 
queries. In this way several picture details can be checked and finally the con- 
clusion can be made whether the object should be accepted or not. If the ob- 
ject is to be rejected the programmable logic outputs the signal for removing 
the object from the belt. 

[49] Queries can either be sent periodically using the scanning principle or 
they are sent only if a certain triggering condition has been asserted. There 
may be many different queries. The logic program decides which message is 
sent in each case. In different applications the query type to be sent may de- 
pend on the reply to the previous query. 

[50] When the operator of a process control system wants to make changes 
in the programmable logic he makes this by means of the programming device, 
as known. If the program modifications to be made require that the image- 
processing program of the camera perform other tasks and give other results 
than those already defined in previous queries, the maintainer sets a new 
query in the logic program, or more precisely a task code for a query with the 
related parameters. If the query code is already familiar to the adaptation pro- 
gram, there is no need for modifying the adaptation program in the camera. 

[51] It is essential to notice that the same person who programs the logic may 
easily now also "program " the camera. There is no need for a specialist in 
camera programming to make program modifications in order to obtain new 
type of results. 
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PREFERRED EMBODIMENT OF THE INVENTION 
[52] Fig. 7 shows a system based on the invention in an environment in which 
the quality of targets 74 coming from device 73 to conveyor 75 has to be con- 
trolled. Device 73 may be an assembly device, a cutter or the like, the function 
element of which, e.g. a press, positioning element or the like (not shown), is 
controlled by means of control signal 76 given by programmable logic 11. To 
simplify, it is supposed that the device in question is a perforating machine that 
perforates metal sheets. 

[53] Initializing data 77 received from the function element is led to one of the 
input ports of the logic. The device feeds finished products continuously onto 
conveyor 75 that brings them forward. In the figure the products are roughly 
drawn as rectangular pieces. Camera 71 monitors the pieces. It has adaptation 
program 710 based on the invention and its task is to control that the perfora- 
tion is made correctly. When a piece 74 is within the shooting area, the sensor 
e.g. a photocell (not presented in the figure) tells the camera to take a picture. 
The picture is stored in the memory of the camera. It can immediately be 
viewed on monitor 72 that is located in the same facilities as the process con- 
trol. The monitor is connected with a long separate cable to the video interface 
of the camera. 

[54] Fig. 8 is an allusive illustration of the camera picture. The coordinates X 
and Y have the values from 0 to 100. Let us suppose that four rectangular ar- 
eas 1, 2, 3, and 4 have to be viewed more in detail. In response to a trigger 
signal from a sensor, programmable logic 1 1 passes, a query via the Modbus 
to the adaptation program 710 and tells the camera software to calculate the 
data given in the message. The query is about the average of the gray scale 
values in area 1. This can be used for checking the camera settings, e.g. the 
gain. The code of this task is 1. Referring to area 2 the dimension of hole 81 
shall be determined. The code of this task is 2. Concerning area 3 the exact 



location of the center shall be determined. The code of the task is 4. About 
area 4 one would like to know between which X coordinates slot 83 is situated, 
i.e. whether the slot is correctly positioned. The code number of the task is 5. 

[55] The structure of the query message has been presented in Fig. 9. The 
upper portion of the figure shows the Modbus message described above. The 
lower portion presents its data field where the data needed by the camera for 
task completion is located. The task is to analyze a picture showing the object, 
and there are four areas in this picture that must be analyzed, as shown in Fig. 
8. Therefore the message informs the number of areas to be analyzed, what 
the areas are, and what exactly must be examined in each area. This informa- 
tion is in the data field in the following order: First there is the number of areas 
to be examined, i.e. four. Next the size of the areas to be examined is given, 
by using the X and Y coordinates in succession, first the coordinates of area 1 
and finally those of area 4. Hence, to define one rectangular area two X and 
two Y coordinates are needed, so the length of one area field is four bytes. 
Thirdly, task definitions for each area are enumerated in succession. 

[56] Table 1 shows, for the sake of clarity, one possible value sequence in the 
data field. 
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Value 



Description 



Position in fig. 9 



4 


Number of the areas to be analyzed 


Number of the areas to be analyzed 


20 


X coordinate of 1 st area 


Coordinates of the 1 area 


30 


X coordinate of the1 SI area 


15 


Y coordinate of the 1 s1 area 


30 


Y coordinate of the 1 st area 


40 


X coordinate of the 2"° area 


Coordinates of the 2 area 


45 


X coordinate of the 2 na area 


5 


Y coordinate of the 2 na area 


30 


Y coordinate of the 2 na area 


55 


X coordinate of the 3 ra area 


Coordinates of the 3 area 


60 


X coordinate of the 3 ra area 


45 


Y coordinate of the 3 ra area 


46 




Y coordinate of the 3 area 


70 


X coordinate of the 4 tn area 


Coordinates of the 4 th area 


90 


X coordinate of the 4 th area 


20 


Y coordinate of the 4 m area 


90 


Y coordinate of the 4 in area 


1 


Average gray scale value in the 1 SI area 


Task relating to the 1 st area 


4 


Every 4 in pixel in calculation 


2 


Surface area in the 2 na area having gray 
scale value greater than the average 


Task relating to the 2 nd area 


4 


Mass center point of the surface area in 
the 3 rd area having gray scale value 
greater than the average 


Task relating to the 3 rd area 


5 


Boundaries of the dark sub-area in the 4 Tn 
area 


Task relating to the 4 th area 


5 


Both x coordinates must be included in the 
reply message 



Table 1 
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[57] In the first data position there is the value 4 that refers to the number of 
rectangular areas to be examined. In the four next data positions X coordi- 
nates (20, 30) and the Y coordinates (15, 30) of the first area to be examined 
are given. 

[58] The value 1 in the data position for the task definition of the first area in- 
dicates that the average gray shade value must be calculated. The value 4 of 
the next data position informs that only every fourth pixel is calculated. It is 
worth noting that the average gray scale value that has been calculated picture 
by picture (product by product) is moving. Its advantage is that external condi- 
tions, such as a change in the lighting or dirt, do not affect the result, as when 
areas lighter or darker than the average shade of gray are calculated they are 
compared to the average shade of gray of the same picture. 

[59] The task to be carried out in area 2 is to calculate the area having the 
level of gray greater the average level of gray. This gives the dimensions of 
hole 81 , fig. 8. The value 2 of the data position indicates this task. 

[60] The task to be carried out in area 3 is to calculate the mass center of the 
area having the level of gray greater the average level of gray, i.e. the center of 
hole 82, fig. 8. The task can be indicated by using one data position and plac- 
ing the value 4 in it. 

[61] The two last data position values, 5 and 5, indicate the task to be carried 
out in area 4. The first 5 means that that the boundaries of the dark area, i.e. 
the boundaries of slot 83 in fig. 8, have to be determined, and the other 5 
means that both X coordinates of these boundaries must be given in the reply 
message. 

[62] The structure of the above described data field and the meaning of the 
values of the data positions of the message are unambiguously known to the 



smart camera, which means that it operates correctly and is able to carry out 
the right tasks using the right values. 

[63] After sending the task-giving message the programmable logic asks at 
regular intervals whether the task has been completed. When the smart cam- 
era has carried out the task, it creates a reply and sends it to the programma- 
ble logic. The camera's reply comprises as many data positions as requested 
in the queries. 

[64] Fig. 1 0 shows the contents of the reply. The task results of the areas are 
given in succession using as many data positions as needed. The reply con- 
tains answers to every question of the query in an unchanged order. In this 
way it is guaranteed that the programmable logic is able to recognize the an- 
swers. 

[65] The first result comprises one data position indicating the average shade 
of gray in area 1 . The second result gives the area of the hole darker than the 
average shade of gray in area 2. This needs only one data position. Next 
comes the task result of area 3. This needs two data positions as the result is 
the X and Y coordinate of the center. Finally we have the task result of area 4 
giving the boundaries of the dark slot in area 4, and more precisely, only the X 
coordinates. Two data positions are needed. 

[66] After the programmable logic has processed the reply, it can send a new 
query based on the given information. The contents of the query is naturally 
programmed in advance in the logic, and the program provides the message 
with the needed data values. 

[67] The system according to the invention can also be applied in a way that 
the same picture includes both the picture of the target to be examined and a 
reference picture. We could take as an example a continuous oven. When 
bread that has come out of the oven is moving to the conveyor, there is a rack 
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beside the conveyor supporting ideally baked bread. The camera shows an 
area where both the ideally baked bread and bread coming from the oven are 
to be seen. The values of each bread on the conveyor are compared to those 
of the ideal bread. The aim is then to keep the breads equally dark by regulat- 
ing the temperature of the oven. Because the reference bread is exposed to 
the same conditions as the breads to be quality-controlled, the external condi- 
tions like dirt, changes in the lighting efficiency etc. do not influence the results. 

[68] The monitor always shows the last picture, and the areas to be examined 
have been framed. For the user it is easy to change the place of the areas to 
be examined if needed, and then feed the coordinates of the areas to the pro- 
grammable logic. There is no need to modify the camera software. 

ANOTHER EMBODIMENT OF THE INVENTION 
[69] Fig. 1 1 shows another example embodiment of the invention. It is used to 
measure the length of rod-shaped objects. The object is e.g. a metal rod com- 
ing from a cutter. It has a certain tolerance. The reference numerals are, where 
applicable, the same as in fig. 7. 

[70] Rods 113 are cut in a continuous process. The rod cut-into-size is taken 
to a trough conveyor limited by its edges 111 and 112. On the edge of the 
trough there are photocells 1 to 4 at a certain distance from each other. They 
are connected to the input of the programmable logic. At a certain distance 
and in the direction of the motion there is smart camera 71 having adaptation 
program 710 based on the invention. A servomotor (not shown) can move the 
camera longitudinally along the trough. First, the photocell is chosen whose 
signal at the rear part of the rod will trigger a function according to the inven- 
tion. In the figure it is cell 2. Then the servomotor moves the camera to a point 
along the trough so that the front part of the rod cut-into-size lies within the vi- 
sion field of the camera. An absolute location sensor tells the exact location of 
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the camera, longitudinally along the trough, to the logic. After that the following 
process may begin. 

[71] When the rear part of rod 113 is right at photocell number 2 camera 71 
takes a picture of the front part of the rod. This picture corresponds approxi- 
mately to the area limited by the dashed line in fig. 12. 

[72] Now the programmable logic sends a task via the bus to the adaptation 
program of the smart camera. The first task is to examine, within an area AY in 
the cross direction to the trough, the X coordinates of the area having gray 
level higher than the average gray level of the area within AY. It is presup- 
posed that the rod is darker in color than the trough. So the longitudinal posi- 
tion of the rod in the trough at the moment when the picture was taken can be 
discovered. The coordinates are sent to the programmable logic that sends the 
next task to the camera. The rectangular area AX has to be examined in the di- 
rection of the coordinate Y. The coordinate of rod end Y1 can be calculated on 
the basis of the gray level values of the area. The exact location of the rear 
end of the rod in the Y-direction is known, so that the logic program calculates 
the length of the rod from the above-mentioned values. If the deviation ex- 
ceeds the tolerance, the rod is rejected. 

[73] If the length of the rods to be cut is changed, the process operator can 
easily modify the logic program and place the camera to a new position along 
the trough. There is no need to modify the camera software. 

[74] The above mentioned two applications serve as examples in describing 
the features of the invention. Naturally there are a huge number of different 
applications. 

[75] The Modbus protocol has been used here as an example of data transfer 
systems and as a process control unit the programmable logic was utilized. Of 
course, any other field bus protocol can be used. Instead of a bus any other 



data transfer link with its protocol may be applied, e.g. connections like the 
Internet, ethernet, a radio communication, an ATM protocol etc. The adapta- 
tion program that is linked to the camera need only be made in such a way that 
it understands the protocol used and is able to work with it. This all is within the 
knowledge of a man skilled in the art. The point of this invention is the fact that 
once the adaptation program has been installed to the camera, the camera 
doesn't need any further programming. All necessary programming is made in 
the programmable logic by the process maintained Unlike in the conventional 
machine vision solutions there is no need for a camera programmer. The pro- 
gramming device may however be any programmable device, e.g. a PC. 

[76] An artisan of the art naturally understands that the programmable logic 
can be replaced also by a factory system, of the suppliers of which the Finnish 
process control system Damatic, the manufacturer Valmet Ltd, and Alcont, the 
manufacturer Honeywell, can be mentioned. In addition, it has to be pointed 
out that in the previous examples only gray scale vales were processed. It is 
clear that when a color camera is used, data calculated from different color 
values may be requested in the tasks. Then the reply gives information about 
three colors. Other such modifications will also be apparent to those skilled in 
the art. 
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